Image processing apparatus and image processing method

ABSTRACT

An image processing system includes a first obtaining section for obtaining a first image and a color mode for the first image; a second obtaining section for obtaining a second image and a color mode for the second image; a priority setting section for setting which of the color mode for the first image and the color mode for the second image priority is to be given to; a color-mode setting section for setting a color mode for a composite image based on the color mode for the first image, the color mode for the second image, and the setting of the priority setting section; a combining section for combining the first image and the second image to produce the composite image; and an outputting section for outputting the composite image with the color mode set by the color-mode setting section.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.10/953,149 filed Sep. 28, 2004 which claims priority from JapanesePatent Application No. 2003-337977 filed Sep. 29, 2003, both of whichare hereby incorporated by reference herein in their entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing system and an imageprocessing method for combining images.

2. Description of the Related Art

Various conventional image processing systems for combining images areknown. As an example, a system for combining pre-registered images(e.g., watermark or background) with input images (e.g., scanned or PDL(page description language)) is known. Another example is a system formerging page numbers with the input image in the order of pages or forcombining, during multiple set copying, a copy number with each set ofcopies.

The image processing system can also output a composite image in which awatermark image, a page number, and input image are combined and thesystem automatically determines whether the output image is inblack-and-white or in color. With automatic color selection (ACS) as thecolor mode, when any color is contained in the source image, thecomposite image is output as a color image.

Thus, conventional image processing systems with ACS will output a colorimage regardless of whether the user desires a color output image solong as the watermark image, page number, copy number contains somecolor, even when the source image is in black-and-white. Thus, forexample, where it would be less expensive to output a composite image toa printer in black-and-white, such conventional systems will typicallyoutput the composite image in color. Consequently, additional costunintended by the user is incurred.

SUMMARY OF THE INVENTION

Accordingly, the present invention has been made to resolve theaforementioned drawbacks and disadvantages of conventional imagingsystems by providing an image processing system and method configured tooutput composite images as intended by a user.

According to one aspect of the present invention, the image processingsystem of the present invention includes a first obtaining section forobtaining a first image and a color mode for the first image, a secondobtaining section for obtaining a second image and a color mode for thesecond image, a priority setting section for setting which of the colormode for the first image and the color mode for the second imagepriority is to be given to. The image processing system further includesa color-mode setting section for setting a color mode for a compositeimage based on the color mode for the first image, the color mode forthe second image, and the setting of the priority setting section. Theimage processing system further includes a combining section forcombining the first image and second images to produce the compositeimage and an outputting section for outputting the composite image withthe color mode set by the color-mode setting section.

Another aspect of the present invention provides an image processingmethod. The image processing method includes a first obtaining step ofobtaining a first image and a color mode for the first image, a secondobtaining step of obtaining a second image and a color mode for thesecond image, and a priority setting step of setting which of the colormode for the first image and the color mode for the second imagepriority is to be given to. The image processing method further includesa color-mode setting step of setting a color mode for a composite imagebased on the color mode for the first image, the color mode for thesecond image, and the setting set in the priority setting step. Theimage processing system further includes a combining step of combiningthe first image and the second image to produce the composite image andan outputting step of outputting the composite image with the color modeset in the color-mode setting step.

According to another aspect of the present invention, an imageprocessing system in disclosed. Among other components, the imageprocessing system includes a first unit that obtains a first imagecorresponding to a first color mode, and a second unit that similarlyobtains a second image corresponding to a second color mode. A combiningunit then combines the first image and the second image to produce acomposite image. A priority setting unit gives priority to either thefirst color mode or the second color mode, and a color-mode setting unitsets the composite image for output in either the first color mode orthe second color mode based on which color mode is given priority. Anoutput unit then outputs the composite image in either the first colormode or second color mode set by the color-mode setting unit.

Further features and advantages of the present invention will becomeapparent from the following description of the preferred embodimentswith reference to the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an image processing system in accordancewith an embodiment of the present invention.

FIG. 2 is a block diagram showing details of the image processing systemof FIG. 1.

FIG. 3 illustrates the format of an image.

FIG. 4 illustrates the structure of packet data.

FIG. 5 is a block diagram showing details of a scanner-image processorin the image processing system of FIG. 1.

FIG. 6 is a block diagram of a printer-image processor in the imageprocessing system of FIG. 1.

FIG. 7 is an external view of an image input/output system thatimplements the image processing system of FIG. 1.

FIG. 8 is an external view of an operation unit of the image processingsystem of FIG. 1.

FIG. 9 shows an initial screen displayed on the operation unit 2006 ofthe image processing system in accordance with an embodiment of thepresent invention.

FIG. 10 shows a popup window displayed when a scan-setting button shown3105 in FIG. 9 is pressed in accordance with an embodiment of thepresent invention.

FIG. 11 shows a screen displayed when a copy tab 3101 is pressed inaccordance with an embodiment of the present invention.

FIG. 12 shows one example of a screen displayed when a box tab 3103shown in FIG. 9 is pressed in accordance with an embodiment of thepresent invention.

FIG. 13 shows one example of a screen displayed when a folder 0 in afolder area 3401 shown in FIG. 12 is pressed in accordance with anembodiment of the present invention.

FIG. 14 is a block diagram of the configuration of software for theimage processing system in accordance with an embodiment of the presentinvention.

FIG. 15 is a block diagram of the configuration of the image processingsystem for performing processing for combining images in accordance withan embodiment of the present invention.

FIG. 16 is a flow chart illustrating processing procedures for imagecombination performed by the image processing system according to thefirst embodiment of the present invention in conjunction with an exampleof processing for combing a scanned image and an image pre-stored in thehard disk.

FIG. 17 is a table showing color modes for a composite image when acomposite-color-mode priority setting means gives priority to an inputimage in accordance with an embodiment of the present invention.

FIG. 18 is a table showing color modes for a composite image when thecomposite-color-mode priority setting means gives priority to an imageto be combined in accordance with an embodiment of the presentinvention.

FIG. 19 is a table showing another example of color modes for acomposite image when the composite-color-mode priority setting meansgives priority to an image to be combined in accordance with anembodiment of the present invention.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Embodiments of the present invention will now be described below indetail with reference to the attached drawings.

First Embodiment

FIG. 1 is a block diagram of an image processing system according to afirst embodiment of the present invention. The image processing systemincludes an image processing system 200 connected to other imageprocessing systems 220 and 230, which have similar configurations to theimage processing system 200, and a personal computer (PC) 240 through aLAN (local area network) 2055. The image processing system 200 cantransmit and receive, for example, electronic mail and files using a FTP(File Transfer Protocol) and/or an SMB (Server Message Block) protocol.

The image processing system 200 according to this embodiment includes acontroller unit 2000, a scanner unit 2070 which is an image inputdevice, a printer unit 2095 which is an image output device, and anoperation unit 2006 which is a user interface. The scanner unit 2070,the printer unit 2095, and the operation unit 2006 are connected to thecontroller unit 2000, which is, in turn, connected to networktransmission means, such as the LAN 2055, and/or a WAN (wide areanetwork). G3 and G4 facsimile transmission, including color-imagetransmission, may also be used. Similar to the image processing system200, the image processing systems 220 and 230 include scanner units 2270and 2370, printer units 2295 and 2395, and operation units 2206 and2306, respectively, all of which are connected to correspondingcontroller units 2200 and 2300.

FIG. 2 is a block diagram showing a detailed configuration of the imageprocessing system 200 shown in FIG. 1. The image processing systems 220and 230 also have similar configurations to the image processing system200. Referring to FIG. 2, the controller unit 2000 is connected to thescanner unit 2070, which is an image input device, and the printer unit2095, which is an image output device. The controller 2000 is alsoconnected to the LAN 2055 and a WAN (wide area network) 2051, tofunction as a controller for inputting and outputting image informationand device information.

A CPU (central processing unit) 2001 controls the entire system of theimage processing system 200. A RAM (random access memory) 2002 functionsas a system work memory for the operation of the CPU 2001 and alsofunctions as an image memory for temporarily storing image data. A ROM(read only memory) 2003 is a boot ROM to store a boot program for thesystem. A hard disk drive (HDD) 2004 stores system software, image data,and so on. An operation-unit interface (I/F) 2005 is a user interfacefor the operation unit (UI) 2006 and outputs image data to the operationunit 2006 so that an image is displayed thereat. The operation-unit I/F2005 also functions to send information, entered by a user of the systemthrough the operation unit 2006, to the CPU 2001.

A network I/F 2007 is connected to the LAN 2055 to input and outputinformation. A modem 2050 is connected to the WAN 2051 to input andoutput image information. Before the modem 2050 transmits a binaryimage, a binary-image rotation section 2052 and a binary-imagecompression/decompression section 2053 change the orientation of theimage and convert the resolution thereof into a predetermined resolutionor a resolution suitable for an image receiving system. The compressionand decompression support, for example, JBIG, MMR, MR, and MH standards.

A direct memory access controller (DMAC) 2009 reads an image stored inthe RAM 2002 without the use of the CPU 2001 and transfers the readimage to an image bus I/F 2011. Alternatively, the DMAC 2009 writes animage, sent from the image bus I/F 2011, to the RAM 2002 without the useof the CPU 2001. The devices described above, i.e., the CPU 2001, theRAM 2002, the operation-unit I/F 2005, the network I/F 2007, the modem2050, the binary-image rotation section 2052, the binary-imagecompression/decompression section 2053, and the DMAC 2009 are connectedto a system bus 2008.

The image bus I/F 2011 also controls input/output of high-speed imagessent through an image bus 2010. Before an image is sent through theimage bus 2010, a compression section 2012 compresses the image into aJPEG image with a 32 pixels×32 pixels. A decompression section 2013decompresses the image upon receipt from the image bus 2010.

A raster image processor (RIP) 2018 receives page description language(PDL) code from a host computer through the network I/F 2007 and the CPU2001 stores the PDL code in the RAM 2002 through the system bus 2008.The CPU 2001 converts the PDL into intermediate code and sends theintermediate code to the RIP 2018 through the system bus 2008 again, sothat the intermediate code is decompressed into a bitmap image (i.e., amultivalued image).

A scanner-image processor 2014 performs appropriate image processing(e.g., correcting, modifying, and editing) on color or black-and-whiteimages received from the scanner unit 2070 and outputs multivalued imagedata. Similarly, a printer-image processor 2016 performs appropriateimage processing (e.g., correcting, modifying, editing) for the printerunit 2095. During printing, the decompression section 2013 performsbinary-to-multivalue conversion, so that the printer-image processor2016 can output binary image data or multivalued image data to theprinter unit 2095.

An image converter 2030 performs image-conversion on an image stored inthe RAM 2002 and has various image-conversion functions used for writingan image back to the RAM 2002. A rotation section 2019 in the imageconverter 2030 can rotate an image with 32 pixels×32 pixels by aspecified angle and can process both a binary input/output and amultivalued input/output. A zoom section 2020 has a conversion functionfor converting the resolution of an image (e.g., from 600 dpi into 200dpi) and a zoom function for zooming an image (e.g., from 25% to 400%).Before zooming, the zoom section 2020 rearranges a 32×32 pixel imageinto a 32 line image.

Based on an input multivalued image, a color-space converter 2021 uses,for example, a matrix operation and a lookup table (LUT) to convert aYUV image, stored in the memory, into a Lab image. The color-spaceconverter 2021 can use of a 3×8 matrix operation and a one-dimensionalLUT to perform known processing for removing ground-color and processingfor preventing show-through. The color-space converter 2021 outputs aconverted image in multi values.

A binary-to-multivalued image converter 2022 converts a 1-bit binaryimage into a multivalued image, for example, into an 8-bit image with256 grayscales. Conversely, a multivalued-to-binary image converter 2026converts an 8-bit, 256-grayscale image in the memory into a 1-bit,2-grayscale image by a technique, such as error diffusion processing,and stores the 1-bit image in the memory. A combining section 2023functions to combine two multivalued images in the memory into onemultivalued image. For example, the combining section 2023 can combine acompany-logo image, which is in the memory, with a document image tothereby readily attach a company logo to the document image.

A thinning section 2024 converts the resolution of an image bythinning-out pixels of a multivalued image, and can output, for example,a ½, ¼, or ⅛ multivalued image. The thinning section 2024 and the zoomsection 2020 in combination can perform a wider variety ofenlargement/reduction processing. A moving section 2025 adds a marginportion to an input binary image or multivalued image or deletes amargin portion from an input binary image or multivalued image andoutputs the resulting image. The rotation section 2019, the zoom section2020, the color-space converter 2021, and the binary-to-multivaluedimage converter 2022 can interoperate with each other. Further, they canalso operate with the combining section 2023, the thinning section 2024,the moving section 2025, and the multivalued-to-binary image converter2026. For example, without the use of the CPU 2001, those sections cancooperate with each other to rotate a multivalued image in the memoryand converts the resolution of the image.

FIG. 3 is a schematic view illustrating an image format for use in thefirst embodiment. An image format for use in the first embodimentutilizes an image packet structure disclosed in, for example, JapanesePatent Laid-Open No. 2001-103473. The compression section 2012rearranges a raster-format image into packets with 32×32 pixels as shownin FIG. 3 and performs JPEG compression thereon for each packet.

FIG. 4 is a schematic view illustrating the structure of a data packetfor use with the first embodiment of the present invention. During JPEGcompression, the compression section 2012 of FIG. 4 provides headerinformation by attaching information to the header packet. Suchinformation can be an ID (identifier) indicating a packet position, acolor space, a Q-table ID, and a data length, to the packet, to provideheader information. In addition, the compression section 2012 (FIG. 2)similarly compresses binary data (i.e., an image area flag) indicating acharacter or a photo and attaches the compressed data to the end of theJPEG information.

In contrast, the decompression section 2013 decompresses JPEGinformation based on the header information and rearranges thedecompressed information into a raster image. With such a packet image,rotating only an image and changing the position of the packet ID allowsimage processing efficiency to be improved. All images flowing throughthe image bus 2010 are converted into packet images. When a raster imageis required for facsimile transmission or for the binary-image rotationsection 2052 or the binary-image compression/decompression section 2053,software is used to convert a packet image into the raster image.

FIG. 5 is a block diagram showing details of the scanner-image processor2014 of the image processing system 200 according to the firstembodiment. Eight-bit brightness signals (for the respective R, G, andB) input from the scanner unit 2070 are converted by a masking processor2501 into standard RGB signals that are independent of a CCD filtercolor. A filter processor 2502 uses, for example, a 9×9 matrix toperform processing for blurring or accentuating an image.

A histogram processor 2503 samples image-signal data of an input image,and uses the data to determine the ground-color level of the inputimage. The histogram processor 2503 creates a histogram by sampling RGBdata in a rectangular area. Around the rectangular area are start andend points, which are at a constant pitch in the main-scanning andsub-scanning directions. When a ground-color removal function or ashow-through protection function is specified, the histogram is read toestimate the ground color of a document. The histogram is stored and ismanaged, together with an image, in the memory and/or on the HDD as aground-color removal level, and is used for image processing duringprint or transmission. A gamma processor 2504 performs processing forincreasing or reducing the density of an entire image. For example, thegamma processor 2504 converts the color space of an input image into anarbitrary color space and/or performs correction processing for color ofan input image.

A color-space converter 2505 converts a pre-zoomed-image signal into aknown Lab-image signal in order to determine whether the original iscolor or black-and-white (B&W). When color-signal components a and b areat a predetermined or higher level defined by a comparator 2506, theoriginal is determined to be chromatic. Otherwise, the original isdetermined to be achromatic color, and the comparator 2506 outputs a1-bit determination signal. A counter 2507 then measures the output fromthe comparator 2506. A text/photo determination section 2508 hasfunctions for extracting a character edge from the input image andseparating the image into characters and a picture, after which atext/photo determination signal is output. This signal is stored in thememory and/or on the HDD together with the image and is used forprinting.

A specific-original determination section 2509 compares the pattern ofthe input image signal and a signal held in the specific-originaldetermination section 2509 and outputs a match or unmatcheddetermination result. This is useful in, for example, preventingcounterfeiting of banknotes and stocks/bonds.

FIG. 6 is a block diagram showing input and output signal flow throughthe printer-image processor 2016 of the image processing system 200 inaccordance with the first embodiment. A ground-color removing section2601 uses an LUT or a 3×8 matrix operation to remove the ground color ofimage data, which removes unwanted fog. A monochrome generator 2602 hasa function for converting color-image data into monochrome-image data.When image is printed in monochrome, the monochrome generator 2602converts, for example, RGB data into gray-monochrome data. For example,the ground-color removing section 2601 can perform a 1×3 matrixoperation for multiplying a predetermined constant signal with RGB toprovide a gray signal.

An output-color correction section 2603 has a function for correctingcolor based on characteristics of the printer unit 2095 to which imagedata is output. For example, the output-color correction section 2603performs processing using a 4×8 matrix operation and direct mapping. Afilter processor 2604 has a function for arbitrarily correcting thespatial frequency of image data and for performing 9×9 matrixoperations. A gamma correction section 2605 has a function forperforming gamma correction based on characteristics of the printer unit2095. The gamma correction section 2605 also typically performsprocessing using a one-dimensional lookup table (LUT).

A halftone correction section 2606 has a function for performinghalftone processing based on the number of gradations of the printingunit 2095. The halftone correction section 2606 can also perform errordiffusion as well as screen processing, such as conversion into 1 bit or32 bits. For a color printer having four drums for respective C, M, Y,and K colors, an inter-drum delay memory 2607 functions as a memory forsuperimposing C, M, Y, and K images by shifting C, M, Y, and K printtimings by an amount corresponding to the pitch of the drums. Thisallows a color printer having four CMYK drums to delay timing formatching the positions of images.

FIG. 7 is an external view of an image input/output system thatimplements the image processing system 200 according to the firstembodiment. The scanner unit 2070, which is an image input device, scansan image on a document and converts the scanned image into an electricalsignal that provides raster image data. A user places a document on atray 2702 of a document feeder 2701 and uses the operation unit 2006 toinitiate scanning. In response, the CPU 2001 issues an instruction tothe scanner unit 2070 so that the document is fed sheet by sheet fromthe tray 2702 of the document feeder 2701 and document images arescanned.

The printer unit 2095, which is an image device, converts raster imagedata into an image on paper. Any image forming system may be usedtherefor. Examples include an electrophotographic system that uses aphotosensitive drum or belt and an inkjet system that directly print animage on paper by ejecting ink from an array of micro-nozzles. Theprinting is started in response to an instruction from the CPU 2001. Theprinter unit 2095 has a plurality of paper-feed stages so as to allowthe user to select paper of different sizes and/or differentorientations, and also has, for example, paper cassettes 2703, 2704, and2705 corresponding to the stages. A paper output tray 2706 receives theprinted document upon exit from the printer.

FIG. 8 is an external view of the operation unit 2006 of the imageprocessing system 200 according to the first embodiment. As shown inFIG. 8, the operation unit 2006 has a liquid crystal display (LCD)section 2801, to which a touch panel sheet 2802 is attached to a displayscreen and soft keys for operating the system. When a key is pressed,the position information of the key is sent to the CPU 2001. A start key2803 is used to start scanning of a document image. Located at thecenter of the start key 2803 is a two-color (green and red) LED 2804,the color of which indicates whether the start key 2803 is operable. Astop key 2805 is used to stop an operation in progress. An ID key 2806is used to enter the ID of a user. A reset key 2807 is used for resetoperations.

FIG. 9 shows an initial screen displayed on the operation unit 2006 ofthe image processing system 200 according to the first embodiment. Thescreen shown in FIG. 9 is also a main screen, which is restored afterimage-processing functions are set. In FIG. 9, a copy tab 3101 is usedto switch to a copy setting screen. A send tab 3102 is used to provide ascreen for selecting a transmission method for the scanned image. Thetransmission method may be facsimile, electronic mail, and the like. Abox tab 3103 is used to switch to a screen with which the user canperform setting for an operation for storing a scanned image or PDLimage onto the built-in HDD, printing the scanned image or PDL imagestored thereon, transmitting the image, or editing the image.

A scan-setting button 3105 is used to display settings, such as aresolution and density, for scanning an image. A window 3104 displaysthe settings set through the scan-setting button 3105. A send-settingbutton 3106 is used to perform setting, for example, for setting a timerduring timer transmission, for storing information on the HDD, and forprinting an image. A display area 3107 displays a transmissiondestination specified using an address-table button 3108. Adetailed-information button 3109 is used to display detailed informationof a destination displayed in the display area 3107. An erase button3110 is used to erase a destination displayed in the display area 3107.

FIG. 10 shows a popup window displayed when the scan-setting button 3105shown in FIG. 9 is pressed. In FIG. 10, a scan-size button 3201 is usedto select and specify a scanning paper-size. An area 3202 displays thespecified scan size. A button 3203 is used to select a document-scanningmode. By depressing the button 3203, the user can select one of threescanning modes: color, black (i.e., black and white), and ACS (automaticcolor section). The color mode can also be selected through theabove-noted copy tab and box tab. With an automatic scanning mode beingselected, when the counter 2507 indicates a value smaller than apredetermined value, the document is determined to be a black-and-whitedocument, otherwise, the document is determined to be a color document,and the result is accumulated. When a color scanning mode is selected, acolor image is accumulated, and when a black scanning mode is selected,a black-and-white image is accumulated.

A button 3204 is used to enter a scanning resolution. A slider 3205 isused to adjust the scanning density for a document and it allows foradjustment in nine steps. A button 3206 is used for automaticdetermination of the density when a fogged-ground image, such as anewspaper image, is scanned. For copying, the button 3206 can beconfigured in the same manner.

FIG. 11 shows a screen displayed when the copy tab 3101 is pressed. InFIG. 11, an area 3301 indicates when the system is ready for copying. Italso displays the number of copies. A button 3302 has a similar functionto the button 3206 and is used to turn on or off a function forautomatically removing ground color. A slider 3303 has a similarfunction to the slider 3205 to adjust the density in, for example, ninesteps.

A text/photo/map button 3304 is used to select a document type, such astext, a photo, a map, a photographic picture, or a printed picture. Anapplication-mode button 3305 is used to set a size-reduction layout(i.e., a function for printing a reduced image of multiple documents onone sheet of paper), a color balance (i.e., fine adjustment for each ofC, M, Y, and K), and so on. A shift/sort button 3306 is used to setfunctions regarding various types of finishing, such as shift sort,staple sort, and group sort. A button 3307 is used to perform settingregarding two-sided scanning and two-sided printing.

FIG. 12 shows one example of a screen displayed when the box tab 3103shown in FIG. 9 is pressed. In FIG. 12, an area 3401 displays a folderarea, which contains logically-divided regions of the HDD. Foldernumbers are pre-assigned to the respective folders and the first fieldfrom the top indicates a folder 0. The ratios of disk capacity used bythe folders are indicated at the sides of the respective folder numbers.Further, arbitrary names, which are displayed in the area 3401 can begiven to folders. An area 3402 represents the amount of space used outof the entire HDD. Such a representation may be realized with a graphicrepresentation as shown in FIG. 12, numeric values, or the like.

FIG. 13 shows one example of a screen displayed when the folder 0 in thefolder area 3401 shown in FIG. 12 is pressed. As shown in FIG. 13,documents 3501 and 3502 are stored in the folder 0. Each of thedocuments 3501 and 3502 contains a plurality of pages. The document 3501is a scanned document, and thus an icon indicating a scanned document,the amount of HDD space used, and a document name that the user canarbitrarily set are displayed. For the document 3502, an icon indicatinga PDL document (i.e., an icon that is different from the icon indicatingthe scanned document), which is converted from PDL and stored, isdisplayed. Pressing these icons causes the selection of the documents tobe displayed, for example, in reverse video.

A send button 3503 is used to send a selected document. A scan button3504 is used to scan an original from the scanner for creating adocument. A select-all button 3505 is used to select all documents in afolder. A delete button 3506 is used to delete a selected document. Aprint button 3507 is used to print a selected document.

An edit button 3508 is used to edit a selected document. That is, bydepressing the edit button 3508, for example, the user can select twodocuments, combine the documents into one document, and store theresulting document. Alternatively, the user can delete a particularpage. A detailed-information button 3509 is used to display detailedinformation of a document currently selected. Pressing thedetailed-information button 3509 displays information, such as aresolution, document size, and color, in addition to a document name.

FIG. 14 is a block diagram showing an exemplary configuration for imageprocessing system software according to the first embodiment of thepresent invention. In FIG. 14, a user-interface (UI) control section4010 controls the display control section. In response to an instructionfrom the UI control section 4010, a copy application section 4020performs a copy operation, a sending application section 4021 performs asending operation, and a box application section 4022 executes scanningand printing through the box screen. A PDL application section 4023submits a PDL print job in response to PDL print data from a networkapplication section 4120.

A common interface 4030 functions to reduce the load ofhardware-dependency of the hardware control section. A job manager 4040organizes job information received from the common interface 4030 andsends the information to downstream document processing sections.

For local copying of document, a scan manager 4050 and a print manager4090 function as a processing section. For remote-copy scan jobs ortransmission jobs, the scan manager 4050 and a file storage manager 4100function as the processing section. For remote-copy reception jobs, afile load manager 4060 and the print manager 4090 function as theprocessing section. And for printing of PDL such as LISP or PostScript,a PDL manager 4070 and the printer manager 4090 function as theprocessing section.

The document managers use a synchronization manager 4080 to synchronizewith each other to issue an image-processing request to an image manager4110, which performs various types of image processing. During scanningor printing, the image manager 4110 performs image processing and storesan image file.

Procedures for the above-noted document processing performed at theimage processing system of the present embodiment will now be furtherdescribed in detail.

First, software processing for local copying will be described.

Initially, upon receipt of an instruction from the user, the UI controlsection 4010 sends a copy instruction and a copy setting to the copyapplication section 4020. In response to the information from the UIcontrol section 4010, the copy application section 4020 transfers theinformation to the job manager 4040, which controls the system, via thecommon interface 4030. The job manager 4040 sends job information to thescan manager 4050 and the print manager 4090.

Subsequently, the scan manager 4050 issues a scan request to the scannerunit 2070 via one of device I/Fs (not shown), which are serialinterfaces for providing a connection between the controller unit 2000and the scanner unit 2070 and a connection between the controller unit2000 and the printer unit 2095. Then, the scan manger 4050 issues animage-processing request for scanning to the image manager 4110 via thesynchronization manager 4080. In accordance with the request from thescan manager 4050, the image manager 4110 performs setting for thescanner-image processor 2014. After completing the setting, the imagemanager 4110 sends a scan-preparation completion notification via thesynchronization manager 4080. Thereafter, the scan manager 4050 issuesan instruction for scanning to the scanner unit 2070.

An image-scan transfer completion notification is sent to the imagemanager 4110 via an interrupt signal from hardware (not shown). Inresponse to the scan completion notification from the image manager4110, the synchronization manager 4080 transfers the scan completionnotification to both the scan manager 4050 and the print manager 4090.In order to convert a compressed image, stored in the RAM 2002, into afile on the HDD 2004, the synchronization manager 4080 issues aninstruction to the image manager 4110. In response, the image manager4110 retrieves a corresponding image from the memory and stores theimage on the HDD 2004. The image manager 4110 also stores a text/photodetermination signal on the HDD 2004. Further, the image manager 4110stores information associated with the image in an SRAM (not shown). Theassociated information includes a color/B&W determination result, aground-color removal level used for removing ground color, a scannedimage as an input source image, and an RGB color space.

Upon receiving a scan completion notice from the scanner unit 2070 afterthe completion of the storage onto the HDD 2004, the image manager 4110indicates through the synchronization manager 4080 that file conversionis complete. The scan manager 4050 then returns a completionnotification to the job manager 4040, which in turn, transfers thecompletion notification to the copy application section 4020 via thecommon interface 4030.

The print manager 4090 issues a print request to the printer unit 2095via the device I/F, when an image is input to the memory. Then, theprint manager 4090 issues a print-image processing request to thesynchronization manager 4080. The synchronization manager 4080 thenissues a setting request for image processing to the image manager 4110.In accordance with the above-described associated information, the imagemanager 4110 performs setting for the printer-image processor 2016 andsends a print-preparation completion notification to the print manager4090 via the synchronization manager 4080. The printer manager 4090 thenissues a print instruction to the printer unit 2095.

A print-image transfer completion notification is then sent to the imagemanager 4110 via an interrupt signal from the hardware (not shown). Inresponse to the print completion notification from the image manager4110, the synchronization manager 4080 transfers the print completionnotification to the print manager 4090. In response to a paper-dischargecompletion notification from the printer unit 2095, the print manager4090 returns a completion notification to the job manager 4040. In turn,the job manager 4040 transfers the completion notification to the copyapplication section 4020 via the common interface 4030. After scanningand printing are completed, the copy application section 4020 issues ajob-completion notification to the UI control section 4010.

Next, software processing for remote-copy scan jobs and transmissionjobs is described.

First, the file storage manager 4100 (as opposed to print manager 4090)receives a request from the job manager 4040. After a scanned image isstored on the HDD 2004, the job manager 4040 receives astorage-completion notification from the synchronization manager 4080.Via the common interface 4030, the job manager 4040 transfers thenotification to the copy application section 4020 for remote copying andtransfers the notification to the sending application section 4021 for atransmission job. Thereafter, both the copy application section 4020 andthe sending application section 4021 issue a request to the networkapplication section 4120 to send a file stored on the HDD 2004.

In response to the request, the network application section 4120transmits the stored file. When the job is started, the networkapplication section 4120 receives setting information regarding copyingfrom the copy application section 4020 and transmits the settinginformation to a remote system. For remote copying, the networkapplication section 4120 uses a communication protocol that is unique tothe system to transmit the setting information. For a transmission job,the network application section 4120 uses a standard file-transferprotocol, such as the FTP or SMB protocol.

For facsimile transmission, after a file is stored, the sendingapplication section 4021 issues a transmission request to a facsimile(FAX) manager 4041 via the common interface 4030 and the job manager4040. The FAX manager 4041 negotiates with the receiving end system viamodem 2050. The FAX manager 4041 then issues a request for necessaryimage processing (e.g., conversion from a color image into ablack-and-white image, conversion from a multivalued image into a binaryimage, rotation, and zooming) to the image manager 4110 and transmits aconverted image to the system at the receiving end.

When there is a printer at a receiving end, the sending applicationsection 4021 issues a print instruction, which acts as a print job. Anoperation for issuing the print instruction is performed in the samemanner as for a remote-copy print job described below. When a boxaddress in the system is specified as a destination, the file storagemanager 4100 stores a corresponding file on the system.

On the other hand, for fax reception, the FAX manager 4041 receives animage via the modem 2050 and stores it as an image file on the HDD 2004.After storing, the FAX manager 4041 issues a notification to the boxapplication section 4022. In turn, the box application section 4022issues a reception-print instruction to the job manager 4040 via thecommon interface 4030. Since the subsequent operation is analogous to anoperation for a typical box print job, the description thereof isomitted.

Next, software processing for remote-copy print jobs is described.

In this case, the network application section 4120 stores an image, sentfrom a transmitting end, on the HDD 2004 and also issues a jobinstruction to the copy application section 4020. The copy applicationsection 4020, in turn, subjects a print job to the job manager 4040 viathe common interface 4030. Unlike the local copying, the file loadmanager 4060 (as opposed to the scan manger 4050) receives the print jobfrom the job manager 4040. In response, the file load manager 4060issues, to the image manager 4110 via the synchronization manager 4080,a request for loading the received image into the memory from the HDD2004.

The image manager 4110 then loads the image into the memory. Uponcompletion of the loading, the image manager 4110 sends a loadcompletion notification to the file load manager 4060 and the printmanager 4090 via the synchronization manager 4080. The job manager 4040also issues an instruction for specifying a paper-feed stage to theprinter unit 2095 via the device interface, and when the image is loadedinto the memory, the print manager 4090 selects the specified paper-feedstage or a stage having a paper size corresponding thereto and issues aprint request. For automatic paper selection, the print manager 4090determines a paper-feed stage based on the size of the image and issuesa print request.

Then, the print manager 4090 issues a print-image processing request tothe synchronization manager 4080. In response, the synchronizationmanager 4080 issues a setting request for image processing to the imagemanager 4110. For example, when an optimum paper size runs out so thatimage rotation is necessary, a rotation instruction is directed to theimage manager 4110, which uses the rotation section 2019 to rotate theimage.

In addition, the image manager 4110 performs setting for theprinter-image processor 2016 and sends a print-preparation completionnotification to the print manager 4090 via the synchronization manager4080. The printer manager 4090 then issues a print instruction to theprinter unit 2095. A print-image transfer completion notification issent to the image manager 4110 via a hardware interrupt signal. Inresponse, the synchronization manager 4080 transfers the printcompletion notification to the file load manager 4060 and the printmanager 4090. The file load manager 4060 then returns a completionnotification to the job manager 4040.

In response to a paper-discharge completion notification from theprinter unit 2095, the print manager 4090 returns a completionnotification to the job manager 4040. In turn, the job manager 4040transfers the completion notification to the copy application section4020 via the common interface 4030. After scanning and printing arecompleted, the copy application section 4020 then issues ajob-completion notification to the UI control section 4010.

Next, software processing for job loading and storing of PDL data isdescribed.

In this case, a request transmitted from a host computer that has inputa PDL print is sent to the PDL application section 4023 via the networkapplication section 4102. The PDL application section 4023 then issuesan instruction for PDL data loading/storing to the job manager 4040 viathe common interface 4030. Subsequently, the PDL manager 4070 (and thefile storage manager 4100) receives the instruction from the job manager4040. Image-input processing after completion of raster-image processingis analogous to the processing for the above-described scan job.

Thereafter, an image in the memory is transferred and stored onto theHDD 2004 in conjunction with the text/photo determination signal. Inthis case, information associated with the image is stored in SRAM (notshown). The associated information includes color/B&W information, PDLimage information, color space (CMYK or RGB) information. After the PDLimage is stored on the HDD 2004, the job manager 4040 receives a storagecompletion notification from the synchronization manager 4080 andtransfers the storage completion notification to the PDL applicationsection 4023 via the common interface 4030. In response to thenotification, the PDL application section 4023 transfers the storagecompletion notification, which indicates that the image has been storedon the HDD 2004, to the network application section 4120. The storagecompletion notification is further transmitted to the host computer thathas input the PDL print. For a PDL print job, the PDL manager 4070 andthe print manager 4090 cooperate with each other to print an imageloaded into the memory.

For printing of an image expanded into PDL and thereafter stored, astored document specified by the UI control section 4010 is issued as aprint job to the box application section 4022. The box applicationsection 4022, in turn, sends the print job to the job manager 4040 viathe common interface 4030. Unlike processing for local copying, the fileload manager 4060 (as opposed to scan manger 4050) receives the printjob from the job manager 4040. The file load manager 4060 then issues,to the image manager 4110 via the synchronization manager 4080, arequest for loading the image specified for printing into the memoryfrom the HDD 2004. After the specified image is loaded, operations thenproceed in a similar manner as described for the remote-copy print jobs,discussed above.

FIG. 15 is a block diagram showing the configuration of the imageprocessing system for performing processing for combining imagesaccording to the first embodiment of the present invention. As shown inFIG. 15, an image is output from a scanner unit 5001 or a PDL expansionsection 5002 and is then selectively input to an input-image processor5003, in which the input image is subjected to known input-imageprocessing. This processing involves automatic color/B&W determinationprocessing, which automatically determines whether the input image is acolor image or a black-and-white image. The resulting document image5004, which has been subjected to the input-image processing, is thenstored in an image memory. Further, a watermark image 5006 to becombined with the document image 5004 is stored on a hard disk 5005 andis loaded into the memory for combination processing. An image combiningsection 5007 combines the watermark image 5006 with the document image5004 and outputs a composite image 5008 to a printer unit 5009.

FIG. 16 is a flow chart of a process for combining images according tothe first embodiment of the present invention. The image combinationprocessing shown in FIG. 16 is an example of combination of a scannedimage and an image pre-stored on hard disk.

First, in step S5000, the user operates the operation unit 2006 toperform setting for combining images and then presses the copy start key2803 to initiate the process. Next, in step S5001, a document image isscanned, and then stored in the memory. At this point, input-imageprocessing is performed for counting the number of color pixels in thescanned image. In step S5002, based on the number of color pixelscounted in step S5001, a determination is made as to whether thedocument image is a color image or black-and-white image, so that acolor mode for the scanned image is determined.

In step S5011, an image to be combined with the scanned image is loadedfrom the hard disk into the memory. During loading, in step S5012, acolor mode that corresponds to and that is stored with the image to becombined is selected, and the color mode for the image to be combined isdetermined. In this case, the color mode for the image to be combinedcan be a predetermined color mode or a predetermined B&W mode, or can bea color mode or a B&W mode that is automatically determined as describedabove. These exemplary four types of color mode for an image to becombined are stored on the hard disk. Thus, an image to be combined isgenerated in advance, a color mode for the image is set or determined,and the set or determined color mode is stored on the hard disk.

In step S5003, when a color mode for the scanned image and a color modefor the image to be combined are both determined, the color mode for thecomposite image is determined. In step S5004, processing is performed tocombine the scanned image and the image to be combined. Thereafter, instep S5005, color-space conversion processing is performed to convertthe color space of the output composite image into a color spacecorresponding to the composite-image color mode determined in stepS5003. In step S5006, the resulting image, which has been subjected tothe color-space conversion processing, is printed out. In step S5007,the composite-copy processing ends.

FIG. 17 is a table showing color modes for a composite image when acomposite-color-mode priority setting unit of the first embodiment givespriority to an input image. In this embodiment, as shown in FIG. 17,where priority is given to an input image (i.e., a scanned image), andwhen “color” is selected for a color mode for a document image, thecolor mode for a composite image is set to “color”, which is the colormode for the document image, regardless of the color mode for the imageto be combined. In contrast, when “black and white (B&W)” is selectedfor the color mode for the document image, the color mode for thecomposite image is set to “black and white”, regardless of the colormode for the image to be combined.

When automatic color selection (ACS) is selected for the color mode forthe document image, the color mode for the composite image is selectedbased on whether the document image is a color or B&W. Thus, when it isdetermined that the document image is in color, the color mode for thecomposite image is automatically set to “color”, regardless of the colormode for the image to be combined. On the other hand, when it isdetermined that the document image is in black and white, the color modefor the composite image is automatically set to “black and white”,regardless of the color mode for the image to be combined.

FIG. 18 is a table showing color modes for a composite image when thecomposite-color-mode priority setting unit in the first embodiment givespriority to an image to be combined. As shown in FIG. 18, where priorityis given to an image to be combined, and when “color” is selected for atleast the color mode for the document image or the color mode for theimage to be combined or when ACS determines that the color mode is“color”, the color mode for the composite image is set to “color” whichis the color mode for the image to be combined. In contrast, when “blackand white” is selected for both the color mode for the document imageand the color mode for the image to be combined or when the automaticcolor selection (ACS) determines that the color mode is “black andwhite”, the color mode for the composite image is set to “white andblack”.

Second Embodiment

In the second embodiment, an example of color modes that are differentfrom the composite-image color modes set when the composite-color-modepriority setting unit of the first embodiment gives priority to an imageto be combined. FIG. 19 is a table showing color modes for the compositeimage when composite-color-mode priority setting unit of the secondembodiment gives priority to an image to be combined.

In the second embodiment, even when “color” is selected (orautomatically determined by ACS) for the color mode for a document imageand the color mode for an image to be combined is determined (eitherautomatically by ACS or otherwise) to be “black and white”, the colormode for the composite image is set to “black and white”.

With the above-described color modes for a composite image, the user canoutput a black-and-white composite image when the source image is blackand white even when the pre-stored images (e.g., watermark image) are incolor.

Other Embodiments

The present invention may be applied to a system implemented by aplurality of pieces of equipment (e.g., a host computer, interfacedevice, reader, and printer) or may be applied to a single system (e.g.,a copier or facsimile machine) implemented by one piece of equipment.

The present invention can also be achieved by supplying a storage medium(or recording medium), in which software program code that accomplishesthe functions of the illustrated embodiments is stored, to a system thata computer (or CPU or MPU) of the system or system reads and executesthe program code stored in the storage medium. In such a case, theprogram code that is read from the storage medium achieves the featuresof the embodiments described above and the storage medium in which theprogram code is recorded is also encompassed by the present invention.Further, not only is the program code that is read from the computerexecuted to achieve the features of the illustrated embodiments, butalso an operating system (OS) or the like that is running on thecomputer may perform part or all of the actual processing in accordancewith an instruction of the program code to achieve the features of theillustrated embodiments. Such an arrangement is also covered by thepresent invention.

Additionally, after the program code read from the storage medium isstored in a memory that is provided in a plug-in card inserted into thecomputer or an expansion unit connected to the computer, a CPU or thelike that is provided in the plug-in card or the expansion unit mayperform part or all of the actual processing in accordance with aninstruction of the program code to achieve the features of theillustrated embodiment. Such an arrangement is also encompassed by thepresent invention.

When the present invention is applied to the above-noted storage medium,the storage medium stores program code corresponding to the flow chartdiscussed above.

An advantage of the present invention is that composite imagescorresponding to a desired output mode can be output as intended by auser. In addition, the composite image can be output in the desiredoutput mode by using a composite-color-mode priority setting system toprovide the desired output mode with priority.

While the present invention has been described with reference to whatare presently considered to be the preferred embodiments, it is to beunderstood that the invention is not limited to the disclosedembodiments. On the contrary, the invention is intended to cover variousmodifications and equivalent arrangements included within the spirit andscope of the appended claims. The scope of the following claims is to beaccorded the broadest interpretation so as to encompass all suchmodifications and equivalent structures and functions.

1. An apparatus comprising: a scanning unit configured to scan an imageon a document to obtain image data; a combining unit configured tocombine the obtained image data and other image data to produce combinedimage data; and a printing unit configured to print, when a first modeis set, black-and-white combined image data regardless of the color ofthe other image data when the color of the obtained image data isblack-and-white, and to print, when a second mode is set, color combinedimage data regardless of the color of the obtained image data when thecolor of the other image data is color.
 2. A method comprising: scanningan image on a document to obtain image data; combining the obtainedimage data and other image data to produce combined image data;printing, when a first mode is set, black-and-white combined image dataregardless of the color of the other image data when the color of theobtained image data is black-and-white; and printing, when a second modeis set, color combined image data regardless of the color of theobtained image data when the color of the other image data is color. 3.A computer-readable storage medium having stored thereoncomputer-executable instructions for performing a printing method, theprinting method comprising: scanning an image on a document to obtainimage data; combining the obtained image data and other image data toproduce combined image data; printing, when a first mode is set,black-and-white combined image data regardless of the color of the otherimage data when the color of the obtained image data is black-and-white;and printing, when a second mode is set, color combined image dataregardless of the color of the obtained image data when the color of theother image data is color.